Skip to content

Build local Yandex Music self-analytics product#9

Merged
karnaksp merged 1 commit into
mainfrom
feat/local-yamusic-self-analytics
Jun 17, 2026
Merged

Build local Yandex Music self-analytics product#9
karnaksp merged 1 commit into
mainfrom
feat/local-yamusic-self-analytics

Conversation

@karnaksp

@karnaksp karnaksp commented Jun 17, 2026

Copy link
Copy Markdown
Owner

Summary

Turns Streamify from an Eventsim/GCP-only demo into a local-first Yandex Music self-analytics product while preserving the legacy data engineering track.

Tracks #4
Tracks #5
Tracks #6
Tracks #7
Tracks #8

Product Value

  • Ingests personal Yandex Music metadata locally without downloading or storing audio.
  • Builds DuckDB/dbt marts for favorite artists/tracks, genre shifts, playlist overlap, repeat signals, diversity, active periods, underrated tracks/playlists, and data quality.
  • Adds Streamlit dashboard plus markdown, JSON snapshot, and CSV action queues.

Data Engineering Impact

  • Raw/Bronze: token-safe metadata ingestion, JSONL/Parquet outputs, manifest row counts and SHA256 checksums.
  • Silver/dbt: typed local staging with robust manifest diagnostics parsing.
  • Gold/dashboard: local marts, Streamlit app, static exports, recommendation queues.
  • Privacy/security: .env/raw/DuckDB/audio guards, sample-only CI/Pages/release artifacts.

GitHub Delivery

Checks

  • make test
  • make acceptance-real locally with private .env token
  • make pages-site
  • GitHub Actions validate-local-product-contract
  • Real raw data, DuckDB, reports, recommendations, public output and .env remain ignored

Notes

Yandex Music live ingestion uses an unofficial client library. Public automation intentionally runs on sample metadata only.

@karnaksp karnaksp force-pushed the feat/local-yamusic-self-analytics branch from da3a704 to fced6da Compare June 17, 2026 16:05
@karnaksp karnaksp force-pushed the feat/local-yamusic-self-analytics branch from fced6da to 91229e6 Compare June 17, 2026 16:07
@karnaksp karnaksp marked this pull request as ready for review June 17, 2026 16:10
@karnaksp karnaksp merged commit b3da3a8 into main Jun 17, 2026
1 check passed
@karnaksp karnaksp deleted the feat/local-yamusic-self-analytics branch June 17, 2026 16:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant